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vABSTBACT 

This is an evaluation cf a Title VII 
- Biliiigual/Bicu^ Education Program conducted in New York City in 

?t979*19B0* Bilingual education was offered to Spanish, Greek, and 

Italian speaking students- The evaluation describes the features of 
|ith;€L.progxam and its goals for both English and Non English speaking 
Estildents, and briefly outlines instructional methodology and 
^^r'natezials* A statistical evaluation of the program, which includes a 
"^Jdiscnssixm of its methodology, presents pre- and post- test scores in 
^Spanish and English language ability for students in grades 
■kindergarten through 8- (APH) 
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COMMUNITY SCHOOL DISTRICT 24 

67-54 80th STREET Virginia E. Morrissey. 

Middle Village. New York 1 1379 Community SuperintandBnt 

Phone: 894-6563 

Final -Evalua-tion Report 
Coimnunity School District 24 
ESEA Title VII Bilinqual/Bicultural Education Program 1979/80 

Progrctta Description/Goals 

District 24 's philosophy for bilingual education is based on the 
fundamental tenet that a student living in a society where 
language and c\iltvire differ from his or her own must be equipped 
to participate meaningfully in the mainstream of that poverty. 
The progr^ is designed to use available language skills to 
foster academic development - it is ir^^nded to diagnose and 
treat reading disabilities. 

Our philosophy of bilingual education may be translated into the 
following district goals with respect to bilingual and bicultural 
education. 

Goals For Non English Speaking Children 
_3__rpoJenable children who participate in the program to function 
comparably with English dominant children. 

2. To provide children with basic concepts and language skills 
needed for beginning reading in the native langiiage and 
reading. 

3. To enable children to become fxinctional bilinguals through the 
strengthening of the native language through the development 
of strong oral and literacy skills in English and the native 
language. 



4, To provide for and foster positive self image through a 
^^cnowledge of their own language and culture through 

experiences to include music art, celebration of holidays, 
foods r dance and social studies project • 

5. To retard academic failure through a positive orientation 
towards school and learning. 

Goals For English Speaking Children 

1. To learn to speak, read and v/rite in a second language 
Spanish, Italian, Greek. 

2. To learn to value the contribution of other cultures. 

II. Target Population 

The program was initially designed to service a total of 1340 

students whose native language is other than English. 
« 

- SCHOOL TO 3E SERV ICED ACTUALLY SERVICED 1979-80 

P.S. 12 
13 
14 
19 
81 
39 
143 
I.S. 61 
Transfiguration 



145 
175 
145 
145 
145 
200 
175 
90 
120 



145 
176 
145 
145 
145 
200 
175 
96 
121 



Ill* Methodology 

The primary thrust of this program was in the mastery of the 
If . • 

English language through the diagnosis and treatment of reading 

dis2d^ilities by developing basic skills. (Spanish) 

A. Perception Skills 

1. Auditory Discrimination 

2. Visual Discrimination 

B. Word Recognition Skills 

1. Sight Vbcetbulary 

2. Picture Clues 

3. Configuration Clues 

4. Contextual Clues 

5. Phonic Skills 

6. Structural Analysis 
C« Comprehension Skills 

1. Word Meaning 

2. Literal Comprehension 

3. Inferential Interpretation 

4. Critical Evaluation 
D. Vocabulary 

1 . Synonyms 

2 . Homonyms 

3. Multiple Meanings 

4 . Antonyms 

5* Figurative Language 
£• Study Skills 

!• Alphabetizing 

2. Parts of Books 



3. Use of Ref^^en^^^ ^^^^^is^^ 

4. Pictorial ^jid 

5* Organizatiori Sl^^ 
P. Oral Reading ^x±li^ 




1. Auditory Dt^cz>^ ^^o^^ 

2. Visual Diseri^^^^^^^^ 
Word Recogniti on ^/'^""^'^^ 
1. Sight Vocabula^^ 

2^ Picture Clu^^ 



3. Conf iguratiQji C 



4* Contextual c^^^ 



5. Phonic Skili^ 
Inventory of Basic^ gk^ 
1. Perception sKil^ 



2. Word Recogni^^io 

3. Comprehensiofi S^^'^^^^ 



l^^ifN il^ 

Note - The target pd??u>^ pup-^ ^^re serviced in 

classes whe^^ " ^^mp^-^^^^ ^^proxiniately 
60% of the ^l^s^' ^^^ty^P^^^^^t were English 
dominant^ puj>> Is ^ ^^.y^ed ^^3c Levy funds • 
Service was ^iv^^ t)C?th ^^^9^t population and 
English doioijian^^ ^^^^15 cost to the 

prograia) . 

Bilingual Slj^c. o>^^'^^\:x:a.'^ ^'^^^^ation in Spanish 
and English ^ ^V^q* ^^^io at P.S. 12, P.S. 14, 



P.S. 19, V.S. 13, P.S. 89, p^S. 143, and 
I.S, 61 

I 

Bilingual and bicultural instruction in 
Greek and English at a 60%/40% ratio at the 
School of The Transfiguration-^ 

Bilingual and bicultural instruction in Italian 
and English at a 60%/40% ratio at P.s. 81. 

IV* Personnel 

The staff for the bilingual/bicultural progremi consisted of 
47 Tax Levied Bilingual classroom teachers # 7 ESEA Title VII 
Bilingual Resoiirce Teachers and 4 ESEA Title Vii Bilingual 
paraprofessionals as well as supplementary instruction for 
selected students in English as a second Istnguage supplied by 
ESEA Title I Program cmd PSEN. 

Bilingual teachers^ paid for by Tax Levy funds ^ Title VII 
Bilingual Resoui.ce teachers amd paraprofessionals were all 
selected and assigned by the first week of September • 

A Program Coordinator had overall responsibility for the 
program and acted as liaison with the school adiainistration 
and personnel^ as well as the program staff* ES£a Title VII 
provided for a bilingual secretary who maintained records r 
. files r inventories as well as other clerical duties • 

V* Bilingual Advisory Council 

The Bilingual Advisory Council held monthly ^^etings. The 
Vgenca for the meeting included the foi louring subjects: 
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Discussion of Proposals, new needs r new 
activities, services, progress^ effects^ 
involvement, roles and responsibilities. 

The BAG was kept informed by the Director of "all current 
bilingual programs including: 

ESEA Title VII Programs 

ESEA Title I and PSEN ESL Programs 

Consent Decree and Lau Programs 

Chapter 720 Bilingual Progreuns 

Cooperation was enlisted in developing, improving and guiding 
the program. The BAG was also involved in the presentation 
of parades and displays celebrating various ethnic cultures. 
The requirement for membership was that the member had to be 
the parent of a child in the Bilingual program. The Bilingual 
Resource Teachers acted as advisors to the executive committee 
and the Project Director served as the District Office 
representative . 

Instmctional Materia-s 

Although the budgeted amount for materials was small for the 
year, materials were purchased from both Title VII and Tax 
Levy lines in order to adequately supply the ESEA Title VII 
Bilingual/Bi cultural program. 

Materials modification, adaptation and development through 
teacher evaluatio?^ -and professional judgment is an ongoing 
process which v/as xj tiated during the first year of the 



progran and will continue for the duration as needed. 

Bilingual materials, supplies and equipment have been 
accuisulated and developed by the professional staff of 
District ?4 over the previous funded lears; therefore, 
continued funding of this progr5im can make creater use 
of these materials for the benefit of the children in need 
of these services. 
VII. Pre-Service Staff Training 

Pre-service staff training for Bilingual Classroom Teachers, 
Bilingual Resource Teachers, Teachers of English as a 
Second Language and Bilingual Paraprof essionals were held 
during September, 1979, The workshops dealt with the status 
of programs and utilization of materials. The subject matter 
was pertinent to and designed to facilitate an efficient 
implementation of the Bilingual/Bicultural Program. 

VIII. Monthly In-Service Staff Training 

The staff in-service training sessions were held on an 
on-going montxxly basis by the Project Director • The agendas 
included Administrative Matters - testing, rosters, assessments, 
deadlines, conferences, dara forms, program responsibilities, 
inventories, material distribution^ program requirements and 
Instructional Matters , discussion of status of programs, 
evaluation designs, identification of needs, articulation 
strategies F development of stibject area instruction through 
ESL instruction, celebration of Ethnic Heritage and Culture 
weeks ^ Teacher Model Materials. 




IX* Dissemination of Results 

The results of the Bilingual/Bicultural evaluation are 
^ discussed at the meetings of the Bilingual Parents Advisory 
Committee and a copy of the report is on file at the District 
Office. The results of the report are also discussed in 
detail with the teachers, project staff, district principals 
and members of the Community School Board. 

District-wide project information was also disseminated via 
the bi-monthly district newsletter written in both English 
and Spanish. 

District produced materials have been and will continue to 
be sent to the Bilingual Resource Center, Regional 
Dissemination Centers, NYC Office of Curriculum, The State 
Education Department as v/ell as to other districts in the 
City. 
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TITLE VII STATISTICAL EVALUATION 

The Title VII Bilingual Program was evaluated iu the two areas 
of Spanish language ability and English language ability. The 
original intention had been to evaluate these programs using the 
LAB test and report the sub scores. The prupose of reporting sub 
scores, vhich are only raw scores » would be to better analyze the 
specific language areas in which the program demonstrated the great- 
est growth* Unfortunately, becuase of the loss of some records and 
problezDS due to change in administrative personnel, virtually all 
of the sub test scores (on a matched basis) were lost. The analysis, 
accordingly, is based on the LAB total percentile scores* 

Methodology 

The statistical analysis was limited to those students for 
whom matched pre and post test scores were available* The total nxim- 
ber of stxidents reported for each grade, therefore, is somewhat less 
than the niober of students enrolled in the program. Data is avail- 
able, however, for a substantial number of students in each grade 
and we foiznd no evidence of any systematic loss of scores* Accordingly, 
it appears reasonable to draw judgements based upon the statistical 
evidence available* 

Since Che purpose of this report is to provide program evaluation, 
the grades are reported here on a district-wide basis* Data is also 



, available to assess the effectiveness of the program in individual 
schools. Since there is frequently only a single teacher in a school 
teaching a specific program in a specific grade, such detailed 
analysis effectively becomes a personnel evaluation. That detailed 
information, although not published, is available for the Program 
Director to assist him in the administration of the program. 

Scores are reported for both Spanish and English test results for 
grades Kindergarten through eighth. In accordance with standard 
procedure. Kindergarten is denoted as grade thirteen, t^or each grade ^ 
a pre test mean score, a post test mean score, and the respective 
standard deviations of those scores are reported. In addition, the 
change or growth from pre to post test is also reported. A negative 
change indicates a regression in performance. 

The scores reported here are percentile scores and not KCE's. 
Percentile scores were reported bacause they are more easily inter- 
preted by the non-statistician and, based upon previous experience^ 
this report is most used by non-statisticians. 

In addition to- the previously mentioned statistics, a t-test 
statistic has been generated. The interpretation of the t-statistic 
calls for reference to a standard table. As a general guideline, 
however, if the number of students tested is ten, a t-statistic 
of 2.26 is highly favorable, whereas if the number of students tested 
is sjcty or larger, a t-statistic of only 2.00 is necessary. A 
second statistic provided is the correlation. Again, this statistic 
is of most value to the statistician. A correlation may range from 
0 to 1.00. The closer the correlation is to 1, the better is the 
indication that the group tested shoved improvement. As the cor- 



relation approaches^ 0.00, there is more evidence that a large portion 
of the group either regressed or did poorly while another large 
portioia of the group improved* Accordingly, when evaluating each 
grade, both the ^ount of percentile change and the correlation should 
be examined* 

Finally, we remind the reader that the pre and post test scores 
are national percentile scores* If the student did not do better 
on an absolute basis (that is, obtain more correct answers) on the 
post test than on the pre test, the student's post test percentile 
would be less than the pre test percentile score. National percen- 
tiles take into consideration the student's grade and a student who 
is maintaining his/her relative percentile in the population would 
have the same pre and post test score. In interpreting the results 
which follow, the reader should then consider that any positive 
change is an indication of growth by the group and any negative change 
is an indication of relative loss by the group. 

Findings 

Examination of the statistics show that with regard to the 
Spanish language, the Kindergarten children did not sliow growth and, 
in fact, showed a loss of approximately 4 percentiles. Children in 
the first grade showed a 4 percent growth. Children in the second 
grade showed an approximate 3 percent loss and in the third grade 
an approximate 16 percent loss. This somewhat erratic pattern con- 
tinued through the eighth grade with only the fifth grade showing 
sufficient positive change, approximately II percent, to be of 
note. The conclusion must be reached that during the 1979-80 year, 
there was relatively little increase in Spanish speaking ability of 
the children in the program. 
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When the results of the LA3 in English are examined, somewhat 
different results are found. -vTnereas the Kindergarten students had 
a pre test percentile,. in Spanish of approximately the 63 percentile, 
which is substantially above average, they were only at the 10 
percentile in English. It is quite understandable that the program, 
would have stressed English for this group in an attempt to maintain 
a balanced bilingual environment. Indeed, Kindergarten students 
improved approximately 19 percent and concluded the year at the 29 
percentile. This pattern is repeated in the first grade and to 
a lesser- extent in the second grade. By the third grade, the mean 
pre test score of the bilingual student in English is approximately 
the 56 percentile and the pre and post scores remain in that general 
area for the third, fourth, and fifth grades. 

In the sixth, seventh, and eighth grades, both the pre and post 
English scores are substantially lower, averaging just over the 
30 percentile. This lower performance and lesser inclination to 
-achieve growth in the English language is characteristic of the 
older student and has been noted in many national studies. 

Summary 

In summary, we- regret that many statistics which we had 
anticipated would be available . this year are not available. New and 
stringent procedures have been instituted to insure that this 
condition will no longer prevail. 

Based on the information available, the program appears to be 
meeting most of its goals. We noted some areas of weakness and 
have discussed particular problems with the Program Director. The 
Program Director has made substantial improvements this year and within 
a short time the Title VII program in this district should becomes a 



- TITLE VII BILINGUAL 1979-SO 
SCHOOL ALL 

SUBTEST TOTAL LEVEL 1 
RAW SCORES • N= 0 
. MEAN 

P8E-TEST SD 
^»OST-TEST SD 

CHANGE 
. T-STATISTIC 
CORRELATION 



TEST LAB SP 

GRADE 13 



PERCENT SCORES N= 3B 
MEAN 

PRE-TEST B3.47 SD 23.68 

POST-TEST 53.33 SD 18.73 

CHANGE -4.14 
T-STATISTIC -0.17 
CORRELATION 0.33 



TITLE ^11 BILINGUAL 1S7S-80 



TEST LAB SP 



SCHOOL ALL GRADE 1 

.SUBTEST TOTAL LEVEL 1 



RAW SCORES N.= 0 




PERCENT SCORES N= 


21 




MEAN 






MEAN 






PRE-TEST 


SD 


PRE-TEST 


Si .S2 


SD 


20.54 


POST-TEST 


SD 


POST-TEST 


65.71 


SD 


. 13.76 


CHANGE 




CHANGE 


4.10 






T-STATISTIC 




T-;STATISTIC 


0.2i 






CORRELATION 




CORRELATION 


0.53 








TITLE yil BILINGUAL 1973-80 
SCHOOL ALL 

SUBTEST TOTAL LEVEL 1 
RAH SCORES N= 0 
MEAN 

PRE- TEST SD 
POST-TEST SD 

CHANGE 

T-STATISTIC 

CORRELATION 



TEST LAB SP 

GRADE 2 



-PERCENT SCORES N= 57 
MEAN 

PRE- TEST S5.B5 SD 25.56 

POST-TEST 63.05 SD 31.07 

CHANGE -2.60 
T-STATISTIC -0.08 
CORRELATION 0.41 



TITLE VII BILINGUAL 1373-80 
SCHOOL ALL 

SUBTEST TOTAL LEVEL 2 
RA» SCORES N= 0 
MEAN 



PRE-TEST 
POST-TEST 



SD 
SD 



TEST LAB SP 



GRADE 3 



PERCENT SCORES N= 81 



PRE-TEST 
POST-TEST 



MEAN 

73.32 

57.17 



SD 
SD 



30.64 
30.21 



CHANGE 

T-STATISTIC 

CORRELATION 



CHANGE -16.15 
T-STATrSTIC .-0.52 
CORRELATION* 0.47 



TITLE mi BILINGUAL 1379-80 
SCHOOL ftLL 

SUBTEST TOTAL LEVEL 2 
.RAU SCORES N- 0 
WEAN* 

PRE-TEST SD 
POST-TEST SD 



TEST LAB SP 

GRADE 4 

PERCENT SCORES N= S9 
KEAN 

PRE-TEST 52. IG SD 29.25- 
POST-TEST 57.78 SD 32.82 



CHANGE 

T-STATISTIC 

CORRELATION 



CHANGE 

T-STATISTIC 

CORRELATION 



5.S2 
0.27 
0.73 



TITLE VII BILINGUAL l^yd^O 
SCHOOL ALL 

SUBTEST TOTAL LEVEL 2 
RAU SCORES N= 0 



MEAN 



PRE-TEST 
POST-TEST 

CHANGE 

T-STATISTIC 

CORRELATION 



So 



TEST LAB SP 



MEAN 

82. 3o SD 26.04 
73.12 SD 23.23 



^HANGjtSTr^ 10.76 
^iORPet-^'^^** 0.80 




TITLE VII BILINGUAL 1979-80. 



TEST LAB SP 



SCHOOL ALL 

SUBTEST TOTAL LEVEL 2 
RAU SCORES n= 0 
MEAN 



PRE-TEST 
POST-TEST 

CHANGE 

T-STATISTIC 

CORRELATION 



SD 
SD 



GRADE 6 



PERCENT SCORES N= zi 



PRE-TE3T 
POST-TEST 



MEAN 

88.05 

87-52 



CHANGE -0.52 
T-STATISTIC -0-05 
CORRELATION 



SD 
SD 



8.31 
12,72 



TITLE VII BILINGUAL 1979-80 
SCHOOL ALL 

SUBTEST TOTAL LEVEL 3 
RAU SCORES N= 0 
MEAN 

PRE-TEST SD 
POST-TEST SD 

CHANGE 

T-STATISTIC 

CORRELATION 



TEST LAB SP 

GRADE 7 



PERCENT SCORES N= 26 
-MEAN 

PRE-TEST 80.73 SD 18.01 

POST-TEST 84.38 SD 14.73 

CHANGE 3.65 
T-STATISTIC 0.37 
CORRELATION 0.84 



TITLE Vri BILINGUAL 1979-80 



TEST LAB SP 



SCHOOL ALL 

SUBTEST TOTAL LEVEL 3 
RAW SCORES N= 0 
MEAN 



PRE-TEST 
POST-TEST 

CHANGE 

T-STATISTIC 

CORRELATION 



SD 
SO 



GRADE 8 



PERCENT SCORES N= 



PRE-TEST 
POST-TEST 

CHANGE 
T-STATISTIC 
- CORRELATION 



MEAN 

93.31 

91.82 

-2.09 
-C.23 
0.55 



22 



SD 
SB 



5.7S 
10.83 



22 



TITLE VII BILINGUAL 1379-80 



TEST LflB EN 



SCHOOL ALL 

SUBTEST TOTAL " LEVEL 1 
RAM SCORES N= 0 
KEAN 

PRE-TEST SD 
POST-TEST SO 



GRADE 13 



PERCENT SCORES N= 4S 



PRE-TEST 
POST-TEST 



MEAN 

10.02 

28.93 



SD 15.88 
SD 23. S3 



CHANGE 

T-STATISTIC 

CORRELATION 



CHANGE 18.91 
T-STATISTIC 0.77 
CORRELATION 0.28 
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TITLE Vir BILINGUAL 1S7S-80 



TEST LAB EN 



SCHOOL ALL 

SUBTEST TOTAL LEVEL 1 



GRACE 1 



RM SCORES N= 



PERCENT SCORES N= 29 



PRE-TEST 
POST-TEST 



MEAN 



SD 
SD 



PRE-TEST 
POST-TEST 



MEAN 

28.00 

57.72 



SD 
SD 



2S.57. 
26.04 



CHANGE 

T-STATISTIC 

CORRELATION 



CHANGE 29.72 
T-STATISTIC 0.7S 
CORRELATION -0.15 



TITLE VII BILINGUAL 1979-80 



TEST LAB EN 



SCHOOL ALL 

SUBTEST TOTAL LEVEL 1 
RAU SCORES N= . 0 
MEAN 



PRE-TEST 
POST-TEST 

CHANGE 

T-STATISTIC 

CORRELATION 



SD 
SO 



GRADE 2 



PERCENT SCORES N= 105 



PRE-TEST 
POST-TEST 

CHANGE 

T-STATISTIC 

CORRELATION 



MEAN 
46. 4S 

70.33 

23.34 
0.33 
0.71 



SO 
SO 



32.13 
35.01 



TITLE WII BILINGUAL 1978-80 
SCHOOL ALL 

SUBTEST TOTAL LEVEL 2 
RAH SCORES H= 0 



MEAN 



^»RE-TEST 
'POST-TEST 

CHANGE 

T-STATISTIC 

CORRELATION 



SO 
SD 



TEST LAB EN 



GRADE 3 



PERCENT SCORES N= 142 



PRE-TEST 
POST-TEST 



MEAN 

55.86 

50.37 



SD 
SD 



37.27 
24.54 



CHANGE -5.49 
T-STATISTIC -0.17 
CORRELATION 0.54 
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TITLE VZI BILINGUAL 1379-80 



TEST LAB EN 



SCHOOL ALL 

SUBTEST TOTAL LEVEL 2 
RAU SCORES H= 0 
MEAN 



PRE-TEST 
POST-TEST 



SD 
SD 



GRACE 4 



PERCENT SCORES N= 12B 



PRE-TEST 
POST-TEST 



KEAN 

47.23 

5S.01 



SD 
SO 



26. S5 
2B.15 



CHANGE 

T-STATISTIC 

CORRELATION 



CHANGE 11.78 
T-STATISTIC 0.5B 
CORRELATION 0.71 



.TITLE VII BILINGUAL 1979-80 



TEST LAB EN 



SCHOOL ALL 

SUBTEST TOTAL LEVEL 2 
RAH SCORES N^: 0 
HEAN 



PRE-TEST 

RpST-lcST 

CHANGE 

T-STATISTIC 

CORRELATION 



SD 
SO 



GRADE 5 



PERCENT SCORES N= 126 



PRE-TEST 
POST-TEST 



MEAN 

44.34 

57.16 



SD 28.42 
SD 31.37 



CHANGE 12.82 
T-STATISTIC 0.61 
CORRELATION 0.75 



TITLE VII BILINGUAL 1979-80 TEST LAB EN 



SCHOOL ALL 

SUBTEST TOTAL LEVEL 2 
RAU SCORES N- 0 



GRADE 6 



PERCENT SCORES N= 50 



MEAN 






MEAN 




PRE-TEST 


SD 


PRE-TEST 


27. 


04 


SD 


POST-TEST 


SD 


POST-TEST 


35. 


08 


SD 


CHANGE 




CHANGE 


8. 


04 




T-STATISTIC 




T-STATISTIC 


0. 


33 




CORRELATION 




CORRELATION 


0. 


83 





29.04 
31.35 



TITLE VII BILINGUAL 1979-80 



TEST LAB EN 



SCHOOL ALL 

SUBTEST TOTAL LEVEL 3 
RAH SCORES N= 0 
MEAN 



PRE-TEST 
POST-TEST 

CHANGE 

T-STATISTIC 

CORRELATION 



SO 
SO 



GRADE 7 



PERCENT SCORES N= 26 



PRE-TEST 
POST-TEST 

CHANGE 

T-STATISTIC 

CORRELATION 



MEAN 

31.04 

33.38 

2.35 
0.12 
0.B7 



SD 
SD 



21.33 
24.41 



TITLE VIZ BILINGUAL 1373-80 



TEST LAB EN 



SCHOOL ALL 

SUBTEST TOTAL LEVEL 3 
RAH SCORES N= 0 
HEAN 



PRE-TEST 
POST-TEST 

CHANGE 

T-STATISTIC 

CORRELATION 



SO 
SD 



GRADE 8 



PERCENT SCORES N= 24 



PRE-TEST 
POST-TEST 



MEAN 

45.00 

38.67 



CHANGE -8.33 
T-STATISTIC -0.41 
CORRELATION 0.76 



SO 31.05 
SD 20.95 



